1 Symbolic Math (Computer Algebra Systems)

There are several free symbolic math tools, including a Macsyma look-alike:

Some others include:

2 Numerical Math

There are several free tools for numerical math available, including some MATLAB look-alikes:

3 Statistical Packages

There are some free tools for statistical analysis available, including an S look-alike: